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AMENDMENTS TO THE CLAIMS 

The following Listing of Claims, with amendment to claim 1 , will replace all prior 
versions, and listings, of claims in the application. No new matter is introduced as a 
result of the following claim amendments. 

1 (Currently Amended). A computer-readable medium encoded with a computer 
program having computer executable instructions for automatically estimating a motion 
field for image frames in an image sequence, said computer executable instructions 
comprising: 

evaluating a first set of zero valued motion vector (MVs) for blocks in an image 
frame using background detection and determining a reliability of each MV; 

evaluating a second set of one or more candidate MVs for each block in the 
image frame for which the first set of zero valued MVs was deemed not reliable, said 
second set of MVs being determined using any of spatial and temporal neighbors of 
each of those blocks, and determining an optimal MV for each block of the second set 
and a reliability of each optimal MV; 

wherein evaluating the second set of one or more candidate MVs for each block 
further comprises computing an error value for each candidate MV and storing that error 
value to a database the first time that each candidate MV is evaluated, and then 
retrieving that error value from the database instead of re-computing the error value 
whenever it is necessary to evaluate any candidate MV again when evaluating MVs in 
neighboring blocks; 

evaluating a third set of candidate MVs for all blocks in the image frame having 
MVs that were deemed not reliable using the first or the second set of MVs, said third 
set of MVs being determined using a block-based pattern search, and determining an 
optimal MV for each block of the third set; and 

outputting an optimal MV for each block using the reliable MVs from the first, 
second and third sets of MVs to form a motion field for the image frame. 
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2 (Original). The computer-readable medium of claim 1 wherein reliability of the 
zero valued MVs is determined by computing error values for the MVs for each block in 
the image frame, and comparing the computed error values to a first error threshold. 

3 (Original). The computer-readable medium of claim 2 wherein each block 
having a computed error value less than the first error threshold is deemed to have a 
reliable zero-valued MV. 

4 (Original). The computer-readable medium of claim 1 wherein each optimal 
MV for the second set is determined by computing error values for each candidate MV 
of each block, and selecting a candidate MV having a smallest computed error value; 

5 (Original). The computer-readable medium of claim 1 wherein the reliability of 
the optimal MVs for the second set is determined by comparing the error value of each 
optimal MV with a second error threshold, wherein any optimal MV having a computed 
error value less than the second error threshold is deemed to be a reliable MV. 

6 (Original). The computer-readable medium of claim 1 wherein a second error 
threshold is computed as a minimum error value of the spatial and temporal neighbor 
blocks. 

7 (Original). The computer-readable medium of claim 1 wherein the error value 
of the optimal MV for the second set is compared against a third threshold value, 
wherein: 

if the error value is larger than the third threshold value, then the third set 
of MVs comprises the entire search range of the block-based pattern search; and 

if the error value is smaller than the third threshold value, then the third set 
of MVs comprises a search range consisting of only immediate neighbor MVs of the 
optimal MV of the second set. 
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8 (Original). The computer-readable medium of claim 7 wherein the third 
threshold value is computed as a maximum of the computed error values of the spatial 
and temporal neighbor blocks. 

9 (Original). The computer-readable medium of claim 1 wherein the pattern 
search is any of: 

a square MV search; 

a spiral MV search; 

a 2D logarithmic MV search. 

a diamond MV search; 

a hexagonal MV search; and 

a two-level hexagonal MV search. 

10 (Original). The computer-readable medium of claim 2 or claim 4 or claim 9 
further comprising an array wherein computed error values for each MV are stored as 
they are computed. 

1 1 (Original). The computer-readable medium of claim 10 wherein the array is 
checked before computing an error value for any candidate MV to determine whether an 
error value for that candidate MV has already been computed, and wherein if the error 
value for that candidate MV has already been computed, then it is read back from the 
array instead of being computed. 

1 2 (Withdrawn). A system for estimating motion vectors (MVs) for blocks in 
an image frame, comprising: 

inputting an image sequence comprising two or more images to a first MV 
estimation stage; 

said first MV estimation stage using background detection to identify candidate 
MVs for background blocks in a current image frame from the image sequence; 
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determining whether each of the candidate MVs for the background blocks are 
reliable; 

passing all blocks in the current image frame that are not background blocks, and 
all blocks in the current image frame that do not have reliable candidate MVs to a 
second MV estimation stage; 

computing candidate MVs and an estimated error for all blocks in the second 
stage, and identifying the candidate MV having the lowest estimated error for each 
block in the second stage as a reliable MVfor each particular block in the second stage; 
and 

outputting the reliable MVs from the first stage and the reliable MVs from the 
second stage as the estimated MVs for the current image frame. 

1 3 (Withdrawn). The system of claim 1 2 wherein the second MV estimation 
stage uses any of spatial and temporal neighbors of each block to compute the 
candidate MVs for each block in the second stage. 

14 (Withdrawn). The system of claim 12 wherein a third MV estimation stage 
uses a block-based pattern search to compute the candidate MVs for each block in the 
third stage for blocks having MVs determined to be unreliable in the second stage. 

1 5 (Withdrawn). The system of claim 1 2 wherein the second MV estimation 
stage uses a block-based pattern search to compute the candidate MVs for each block 
in the second stage. 

1 6 (Withdrawn). The system of claim 1 4 or claim 1 5 wherein the block-based 
pattern search is any of: 

a square MV search; 

a spiral MV search; 

a 2D logarithmic MV search; 

a diamond MV search; 
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a hexagonal MV search; and 

a two-level hexagonal MV search. 

1 7 (Withdrawn). A computer-implemented process for estimating motion 
vectors (MVs) for blocks comprising image frames in a sequence of image frames, 
comprising using a computer to: 

input an image sequence comprising two or more images to a first MV estimation 

stage; 

said first MV estimation stage using background detection to identify candidate 
MVs for background blocks in a current image frame from the image sequence; 

determine whether each of the candidate MVs for the background blocks are 
reliable; 

pass all blocks in the current image frame that are not background blocks, and all 
blocks in the current image frame do not have reliable candidate MVs to a second MV 
estimation stage; 

said second MV estimation stage using any of spatial and temporal neighbors of 
each block to compute candidate MVs for each block in the second stage; 

compute an estimated error for each candidate MV computed for the second 
stage and identifying the candidate MV having the lowest estimated error for each block 
in the second stage as a best candidate MV for each block; 

determine whether each of the best candidate MVs for each of the blocks in the 
second stage are reliable; 

pass all blocks in the current image frame from the second stage that do not 
have reliable candidate MVs to a third MV estimation stage; 

said third MV estimation stage using a block-based pattern search to compute 
candidate MVs for each block in the third stage; 

compute an estimated error for each candidate MV computed for the third stage 
and identifying the candidate MV having the lowest estimated error for each block in the 
third stage as a reliable MV for each block; and 
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output the reliable MVs from the first, second and third stages as the estimated 
MVs for the current image frame. 

1 8 (Withdrawn). The computer-implemented process of claim 1 7 wherein the 
block-based pattern search is any of: 

a square MV search; 

a spiral MV search; 

a 2D logarithmic MV search; 

a diamond MV search; 

a hexagonal MV search; and 

a two-level hexagonal MV search. 

1 9 (Withdrawn). The computer-implemented process of claim 1 7 further 
comprising an array, equal in size to the number of MVs to be searched, wherein 
estimated errors for each MV are stored as they are computed. 

20 (Withdrawn). The computer-implemented process of claim 19 wherein the 
array is checked before computing the estimated error for any candidate MV to 
determine whether an error value for that candidate MV has already been computed, 
and wherein if the estimated error for that candidate MV has already been computed, 
then it is read back from the array instead of being computed. 

21 (Withdrawn). The computer-implemented process of claim 17 wherein the 
reliability the candidate MVs for the background blocks is determined by computing 
error values for the MVs for each block in the image frame, and comparing the 
computed error values to a first error threshold. 

22 (Withdrawn). The computer-implemented process of claim 17 wherein the 
reliability of the MVs for the second stage is determined by comparing the error value of 
each best candidate MV with a second error threshold, wherein any best candidate MV 
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having a computed error value less than the second error threshold is deemed to be a 
reliable MV. 

23 (Withdrawn). The computer-implemented process of claim 22 wherein a 
second error threshold is computed as a minimum error value of the spatial and 
temporal neighbor blocks. 

24 (Withdrawn). The computer-implemented process of claim 17 wherein the 
error value of the best candidate MV for the second stage is compared against a third 
threshold value, wherein: 

if the error value is larger than the third threshold value, then the third stage of 
block-based pattern search comprises the entire search range; and 

if the error value is smaller than the third threshold value, then the third stage of 
block-based pattern search comprises a search range consisting of only immediate 
neighbor MVs of the best candidate MV of the second stage. 

25 (Withdrawn). The computer-implemented process of claim 24 wherein the 
third threshold value is computed as a maximum of the computed error values of the 
spatial and temporal neighbor blocks. 
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